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(57) ABSTRACT 

Physical or electronic objects are encoded with identifiers, 
which serve to trigger object appropriate responses from 
computer systems that encounter such objects. The encoding 
may be steganographic (e.g., by digital watermarks), so the 
presence of such identifiers is not evident to persons encoun- 
tering the objects. An exemplary application is a computer 
system that looks at a printed magazine advertisement (20) 
and initiates a link to a corresponding internet page. In one 
such implementation, the computer system senses an iden- 
tifer encoded in the advertisement, forwards the identifier to 
remote database, receives from the database (17) a corre- 
sponding internet address (18fl, 18b, 18c), and directs a 
browser to that address (18fl, 186, 18c). The same arrange- 
ment can be used for on-line ordering from printed mer- 
chandise catalogs. Another application is a computer system 
that looks at a printed spreadsheet (20), and retrieves from 
disk storage an electronic version of the same document for 
editing. 
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PAPER-BASED CONTROL OF COMPUTER 
SYSTEMS 

RELATED APPLlCAnON DATA 

[0<)0l] This apphcadon is a continuation-in-part of co- 
pending application Ser. No. 09/130»624, filed Aug. 6» 1998, 
which is a continuation of application Ser No, 08/508,083 
(now U.S. Pat. No. .5,841,978). 

[0002] The subject matter of iliis application is generally 
related to that in all of the assignee's other patents and 
applications, e.g., U.S. Pat. Nos. 5,841,886, 5,832,119, 
5,822,446 and 5,841,978. and the application entitled Meth- 
ods and Systems Employing Digital Watermarking, filed on 
even date herewith. 

HELD OF THE INVENTION 

[0003] Tlie present invention relates to use of printed 
documents to control computer systems. Exemplary docu- 
ments include business cards, advertisements, aiKl identifi- 
cation badges, but the invention is not so limited. 

BACKGROUND AND SUMMARY OF THE 
INVEN-nON 

[0004] Over the past century, business cards have formed 
part of business ritual. Functionally, tbey serve as a record 
of an encounter, and deuil means by which the giver may be 
contacted (address, phone, etc.). 

[0005] Business cards have changed, essentially, not at all 
in response to the advent of computers. Some accommoda- 
tion has been made for business cards oo the computer side, 
in the form of specialized scanner and optical character 
recognition tools by which textual data printed on cards can 
be read and entered into personal productivity soDtware tools 
(e.g. coiitact managers, address books, d&tebooks, personal 
information managers, etc.). However, the data transferred 
into the personal productivity software is static and 
unchanging. 

[0006] In accordance with one embodiment of the present 
invention, the textual information on a business card is 
supplemented with steganographically-encoded, multi-bit 
binary data, lliis latter data does not significantly distract 
from the visual aesthetics of the card (as would a bar code 
or the like), yet can be used by an associated computer to 
initiate a link to an internet site corresponding to the 
business card giver. Al the site, the recipient of the card may 
gain access lo the giver's schedule, and other information 
lhat changes over time. (Such infonnation may not generally 
be available over the inlernet to persons without the card 
data.) 

[0007] The foregoing and additional features and advan- 
tages of the present invention will be more readily apparent 
from the following detailed description, which proceeds 
with reference to the accompanying drawings, 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0008] FIG. 1 shows a fiow chart of a process according 
lo one embtKlimenl of the present invention. 

DETAILED DESCRIPTION 

[0009] Digital watermarking is a quickly-growing field of 
endeavor, and many techniques arc known. Generally, all 



seek to steganograpbically convey multi-bit data ancillary to 
some other signal or medium, 

[0010] The present assignee's prior application Ser. Uo. 
09/127,502, filed Jul. 31. 1998, shows techniques by which 
very fine lines can be printed on a medium to slightly change 
the medium's apparent tint, while also conveying digital 
data. Commonly-owned application Ser. No. 09A)74,034, 
filed May 6. 1998, details how the contours of printed 
imagery can be adjusted to convey digital data. (That 
technique can be applied to printed tcxLcharactcrs, as well 
as the line art imagery particularly considered.) AppUcant's 
U.S. Pat. No. 5350,481 details how the surface of paper or 
other media can be textured to convey optically-detectable 
binary data. Applicant's U.S. Fat, Nos, 5,841,886, 5.809, 
160, and the priority applications detailed above, detail 
various techniques for steganograpbically encoding photo- 
graphs and other imagery. 

[0011] Three papers by Brassil et al show other techniques 
for conveying watermark data by slight changes to printed 
text, "Electronic Marking and Identification Techniques to 
Discourage Document Copying,*' Proceedings of INFO- 
COM '94 Conference on Computer. IEEE Comm. Soc 
Conference, Jun. 12-16. 1994, pp. 1278-1287; •'Hiding 
Information in Document Images," November. 1995, 7 
pages, AT&T Bell Laboratories Technical Report (available 
at ciss95j)s,z firom ftp://ftp.research.att.com/dist/brassil/ 
1995/ciss95.ps,Z,; and ''Document Marking and Identifica- 
tion using Both Line and Word Shifting,'* INFOCOM '95 
(available at ftp://ftp.rcscarch.att.comydist/brassil/l 995/ 
infocom95.ps.Z). 

[0012] The foregoing is just a sampling of Ihe large 
literature on watermarking. The artisan is presimied to be 
familiar with such art. all of which is generally suital>lc for 
use with the novel concepts detailed below. 

[0013] In accordance with any of the known watermarking 
techniques, a business card is steganograpbically encoded 
with plural bit data. At least part of this data identifies an 
internet address or web site at which data about the giver of 
the card is stored. If sufficient bits can be encoded into the 
business card, the address can be encoded literally, e.g., by 
ASCII or binary numeric encoding. Alternatively, to reduce 
the data payload, an abbreviated form of address. One 
example of such an abbreviated form is a Unique Identifier 
(UID) which can be, e.g., a 24-bit value. 

[0014] Desirably, the sleganographic encoding is tailored 
to facilitate decoding in ihe presence of arbitrary rotation or 
scale distortion of the card introduced during scanning. 
(Some such techniques arc sho wn, e.fi.^ in applicant's related 
patents identified above. Others are known to artisaas.) 

[0015] As shown in FIG. 1, the card is scanned (e.g., by 
use of conventional opto-clcctronic devices, such as a scan- 
ner or a digital camera). The output data is the n optionally 
pnoccssed lo acco unt for any skew oj scale factor. The 
p lural-bit d i gital data is then dccodccTand sto red, e.g., in 
per soqal productivity software. 

[0016] (Although not particularly shown in FIG. 1, it is 
expected lhat the detailed process will often be supplemental 
to known OCR-reading of business cards, and cntr>' of the 
textual data into personal productivity .software. That is, the 
scan data is processed both by O^R techniques, and by 
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steganographic decoding techniques, and the results of both 
operations stored in a data structure or other memory for 
later reference.) 

[0017] The steganographically-decoded plural-bit data is 
provided to a web browser or other internet appliance and 
used to initiate a link to a remote computer over the 
internet's network of computers. If the remote address was 
literally encoded in the business card, that address is used 
directly. If an abbreviated form of address was encoded, an 
additional step may be required. 

[0018] If a UID was encoded in the card, rather than a 
literal address, the web browser might consult an index to 
correlate the UID to an address. The index could be a table 
or other data structure stored on the user's local computer, 
but more commonly is a remote name server database to 
which the browser links as a default when processing 
business card UIDs. Data obtained from the index is then 
used to complete the linking to the ultimate destination. (In 
addition to reducing the business card payload, such linking 
through an index, e.g., by a UID, offers flexibility in that the 
ultimate destination can be moved to other server sites as 
needed, with just a simple update to the index. Alternatively, 
all business cards encoded with the former address would be 
rendered obsolete if the site were relocated.) 

[0019] At the ultimate site, the user is presented with 
whatever information the business card giver chooses to 
provide, including biographical information, photos, promo- 
tional offers or advertisements relating to the card-giver's 
business (or relating to enterprises to whom the card-giver 
has rented screen space), etc., etc.. In one embodiment, the 
giver's site is linked to the giver's personal productivity 
tool(s) and permits viewing, e.g., of calendar information 
(showing where the business card giver is scheduled to be 
today, or for the rest of the week, month, etc.) 

[0020] Typically, this calendar information is not available 
to casual web browsers; the steganographically decoded data 
from the business card includes some authentication data 
(akin to a password) that permits access to otherwise 
restricted data. This authentication data can take the form of 
a web page address to which no publicly-accessible link 
points, a password that is separately presented to the web 
server by the user's browser after a link is established, or 
other known technique. 

[0021] In one form of the invention, the giver of business 
cards may have several differently-encoded cards, each with 
a different level of access authorization. Thus, some cards 
may access a biographical page without any calendar infor- 
mation, other cards may access the same or different page 
with access enabled to today's calendar, and still other cards 
may access the same or different page with access enabled 
for the card-giver's complete calendar. 

[0022] The reference to business cards and personal cal- 
endars is illustrative only. The invention is more widely 
applicable. Going back a century, "calling cards" were used 
by persons whose interests were strictly social, rather than 
business. The principles of the present invention can simi- 
larly be applied. Teenagers can carry small cards that can be 
exchanged with new acquaintances to grant access to private 
dossiers of personal information, favorite music, artwork, 
video clips, etc. The cards can be decorated with art or other 
indicia that can serve purposes wholly unrelated to the 
linking data steganographically encoded therein. 



[0023] Even the "card" paradigm is too restrictive. The 
same techniques can be applied to any object. A music CD 
cover can be encoded to point to a promotional site associ- 
ated with the music artist. A book jacket can link to a similar 
site. Printed advertising distributed through the US mail 
(cards, magazines, etc.) can be encoded to point to related 
web-based promotional sites. (Sponsors of such advertising 
or other sites can reward visits to their internet site by 
issuing visitors digital tokens or coupons that can be 
redeemed for premiums, cash-back, etc., either for any such 
visit, or only if the visit was effected through the portal of 
a steganographically-encoded printed medium.) «^:=i» 

[0024] Many contexts arise in which data to be presented 
to a consumer is valuable only if timely. The postal service 
mail is ill-suited for some such information due to the 
latency between printing a document, and its ultimate deliv- 
ery to a recipient. The principles of the present invention 
allow the recipient to take a steganographically-encoded 
data object (card, etc.) that was printed well before delivery, 
and use it on receipt to receive up-to-the-minute informa- 
tion. (In this and other embodiments, the stcganographi- 
cally-en coded data can also include data uniquely identify- 
ing the'HrecipjentAiigFI^I^^b^ web site can present data 
customized Jojhat.user.) 

[0025] The present technology also has application in 
access control systems. An identification badge (either with 
photo or graphics, or with text alone) can be encoded with 
steganographically access control data (e.g., access codes or 
digital keys) that is recognized by optical-scanner-equipped 
locks and the like, permitting access by authorized persons 
to restricted areas or restricted services (e.g., computer 
privileges). Given the low cost of media and printing (as 
compared with other access control technologies), the cards 
can be issued on a daily, weekly, or other frequent interval, 
and the access control system can be programmed to permit 
access in response to such cards only for the pre-set limited 
period. Lost cards soon lose their threat. 

[0026] Tickets to sporting events, concerts, and other 
events can be steganographically encoded to permit the 
bearer to access premium web content available only to 
those who have purchased tickets (e.g., an on-line text-, 
audio-, or video-chat session with the featured performer or 
sports star the day before the event). Alternatively, the 
encoded data may link to a transactional site. In some such 
embodiments, the ticket is printed with a nominal show data 
and seat assignment, but also includes a UID in addition to 
the encoded address of an associated transactional ticket site. 
The user then can visit the transactional web site to change 
sealing (or dale). On attending the event, the consumer 
presents the ticket to a steganographic decoder apparatus 
that discerns the UID and looks up the seat assignment 
most-recently picked by the consumer. It then prints a chit 
entitling the consumer to take the seat earlier selected 
on-line. 

[0027] The reference to "scanning" of objects naturally 
brings ,10 mind images of desktop flatbed scanners, or 
multi-function hydra devices. While such devices can be 
used — together with convention digital cameras (including 
video cameras) — the inventors foresee that image input 
devices will soon be much more commonplace. The provi- 
sion of digital cameras as built-in components of certain 
computers (e.g., the Sony Vaio laptops) is just one manifcs- 
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tation of this trend. Another is camera-on-a-chip systems, as 
typified by U.S. Pat. No. 5,841,126 and detailed in Nixon et 
al, "256x256 CMOS Active Pixel Sensor Camera-on-a- 
Chip " IEEE J. Solid-State Circuits, Vol. 31(12), pp. 2046- 
2051 (1996), and Possum, "CMOS Image Sensors: Elec- 
tronic Camera-on-a-Chip," IEEE Transactions of Electron 
Devices, vol. 44, No. 10, October 1997. Still another is 
head-mounted cameras (as arc presently used in some com- 
puter-augmented vision systems). These and other image 
input devices can all be used in connection with the present 
invention. 

[0028] To facilitate embodiments of the present invention, 
a prior art camera-on-a-chip system can be modified to also 
include a steganographic watermark detector on the same 
semiconductor substrate. Such a chip — in addition to pro- 
viding image output data — can also analyze the image data 
to discern any steganographically encoded data, and produce 
corresponding output data. (Again, such analysis desirably 
includes correction for scale and rotation factors, so precise 
positioning of the object being "read" is not essential for 
correct decoding.) 

[0029] To provide a comprehensive disclosure without 
unduly lengthening this specification, applicants incorporate 
by reference the patents, applications, and publications 
identified above. 

[0030] Having described an illustrated the principles of 
our invention with reference to illustrative embodiments, it 
should be recognized that the invention is not so limited. 

[0031] For example, while certain of the embodiments 
were illustrated with reference to an internet-based embodi- 
ment, the same techniques are similarly applicable to any 
other computer-based system. Likewise, for internet-based 
embodiments, the use of web browsers and web pages is not 
essential; other digital navigation devices and other on-line 
data repositories can be similarly accessed. 

[0032] In view of the many embodiments to which the 
principles of our invention may be applied, it should be 
recognized that the detailed embodiments are illustrative 
only and should not be taken as limiting the scope of our 
invention. Rather, we claim as our invention all such 
embodiments as fall within the scope and spirit of the 
following claims, and equivalents thereto. 

We claim: 

1. A method comprising: 

presenting a business card of an individual to an optical 
sensor, the optical sensor producing output data; 

decoding steganographically-encoded plural-bit data 
from the sensor output data; and 

using said plural-bit data to establish a link to an internet 
address having data relating to the proprietor of said 
business card. 



2. The method of claim 1 which includes obtaining from 
said internet site calendar data detailing certain activities of 
the individual. 

3. The method of claim 2 in which the amount of calendar 
data obtained depends on an authorization level. 

4. The method of claim 3 in which the authorization level 
is reflected in the plural-bit data encoded in the individual's 
business card, wherein an individual can distribute differ- 
ently-encoded cards to different recipients, to grant the 
recipients different access rights to said calendar data. 

5. The method of claim 1 in which the optical sensor is a 
business card reader that also serves to input textual infor- 
mation from business cards into a personal information 
manager. 

6. The method of claim 5 which includes storing an 
internet address discerned from the steganographically-en- 
coded plural-bit data into said personal information man- 
ager. 

7. The method of claim 1 in which the optical sensor is a 
digital camera. 

8. The method of claim 7 in which the digital camera is 
mounted to a computer display device. 

9. The method of claim 7 in which the digital camera is 
head-mounted on a user thereof. 

10. A method comprising: 

presenting a printed promotion to an optical sensor at a 
first site, the optical sensor producing output data; 

decoding steganographically-encoded plural-bit data 
from the sensor output data; 

using said data to establish a link to an internet site 
relating to a company, product, or service promoted by 
said printed promotion; and 

transferring to from the internet site to the first site 
additional information relating to said company, prod- 
uct, or service. 

11. A method comprising: 

. presenting a printed identification badge to an optical 
sensor, the optical sensor producing output data corre- 
sponding to optical characteristics of the face of said 
badge; 

decoding steganographically-encoded plural-bit data 
from the sensor output data; 

checking the plural-bit data to determine whether il cor- 
responds to a valid access card; and 

unlocking a lock depending on the outcome of the fore- 
going checking operation. 

♦ ♦ * * « 
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